1 MULTI-RESOLUTION BOUNDARY ENCODING APPLIED 

2 TO REGION BASED STILL IMAGE AND VIDEO ENCODING 

3 Technical Field 

4 The present invention relates to still image and video encoding, and, in particular, to region 

5 based still image and video encoding. 

6 Background 

7 Video encoding may include image encoding and boundary encoding. Existing boundary 

8 encoding techniques, such as MPEG-4, typically use differential chain codes for generating region 

9 based encoding. An examples of differential chain encoding is described in Muller, et. al., 

1 0 "Progressive Transmission of Line Drawings Using the Wavelet Transform," IEEE Transactions On 

1 1 Image Processing, Vol. 5,No. 4, April 1996. Differential chain encoding techniques typically use 

12 directional vectors on a square grid of for example, 4x4 pixels. 

1 3 However, MPEG-4 and other differential chain encoding techniques only code the pixel 

1 4 boundaries of the regions, and thus may not have an overall multi-resolution representation. As a 

1 5 result, if some information is lost in transmission, the boundary of the whole region may be 

16 misplaced. 

1 7 Fourier series based encoding is the next step in boundary encoding, with coordinates of 

1 8 a curve periodically extended and Fourier transformed. However, Fourier series encoding only 

1 9 generates good localization in frequency, but not good localization in space. Accordingly, once 

20 there is error in transmission, i.e. , some of the coefficients or data bits are lost, the boundary may 

21 be misplaced. 

22 Summary 

23 A method for applying multi-resolution boundary encoding to region based still image and 

24 video encoding includes dividing an original image into aplurality of regions and detecting aplurality 

25 of boundaries associated with the plurality of the regions. The method further includes encoding 

26 each of the plurality of the boundaries so that each of the plurality of the boundaries contains 

27 different resolution coefficients. The method also includes decomposing each of the plurality of the 

28 regions in the original image into one or more subbands using the plurality of the boundaries with 

29 the highest resolution coefficients, and successively decomposing each of the plurality of the regions 
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1 in a subband with lower resolution coefficients into one or more subbands using the plurality of the 

2 boundaries with lower resolution coefficients. 

3 The method for applying multi-resolution boundary encoding to region based still image and 

4 video encoding further includes transmitting the lowest resolution boundary and image information, 

5 and successively transmitting higher resolution boundary and image information. 

6 This method uses multi-resolution encoding for image and for boundary and allows for 

7 better error correction for low frequency transmission. By using j oint source channel coding 

8 (JSCC) techniques, a receiver with low resolution capability or low channel bandwidth may still 

9 render a close approximation of a boundary despite error in transmission. 

1 0 Description of the Drawings 

1 1 The preferred embodiments of the multi-resolution encoding will be described in detail with 

12 reference to the following figures, in which like numerals refer to like elements, and wherein: 

1 3 Figure 1 illustrates exemplary hardware components of a computer that may be used to 

1 4 implement the multi -resolution boundary encoding; 

15 Figure 2 illustrates an exemplary boundary encoded at full resolution; 

1 6 Figures 3 (a) and 3 (b) illustrate an exemplary method for encoding two one-dimensional 

17 periodical signals using wavelet based encoding at different resolution levels; 

1 8 Figures 4(a)-(c) illustrates how the exemplary boundary shown in Figure 2 is represented 

19 in multi-resolution encoding; 

20 Figure 5(a) illustrates an exemplary multi -resolution representation for boundaries; 

2 1 Figure 5 (b) illustrates an exemplary comparison of Fourier series encoding and wavelet 

22 based encoding with or without transmission errors; 

23 Figures 6(a)-(c) illustrate an exemplary image encoding using subband encoding technique; 

24 Figures 7(a)-(d) illustrate an exemplary multi-resolution decomposition of an image and an 

25 associated boundary; 

26 Figures 8(a)-(e) illustrate an exemplary process of progressive reconstruction of the image 

27 and the associated boundary; and 

28 Figure 9 is a flow chart of the exemplary decomposition and reconstruction process 

29 illustrated in Figures 7 and 8 using multi-resolution boundary encoding. 
30 
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1 Detailed Description 

2 A method and an associated apparatus applies multi-resolution boundary encoding to 

3 region based still image and video encoding, allowing better error correction for low frequency 

4 bands. High frequency bands may be less protected, leaving only lower frequency representation 

5 highly protected. A receiver with low resolution capability or low channel bandwidth, such as a 

6 wireless device, may still render a close approximation of a boundary despite error in transmission. 

7 Figure 1 illustrates exemplary hardware components of a computer 1 00 that may be used 

8 to implement the multi-resolution boundary encoding. The computer 1 00 includes a connection 

9 with a network 1 1 8 such as the Internet or other type of computer or telephone networks. The 

1 0 computer 1 00 typically includes a memory 1 02, a secondary storage device 1 1 2, a processor 114, 

1 1 an input device 116, a display device 110, and an output device 108. 

1 2 The memory 1 02 may include random access memory (RAM) or similar types of memory . 

13 The memory 102 may be connected to the network 1 18 by a web browser 106. The web 

1 4 browser 1 06 makes a connection via the world wide web (WWW) to other computers known as 

1 5 web servers, and receives information from the web servers that are displayed on the computer 

16 100. The secondary storage device 1 1 2 may include a hard disk drive, floppy disk drive, CD- 

17 ROM drive, or other types of non- volatile data storage, and may correspond with various 

18 databases or other resources. The processor 114 may execute information storedin the memory 

19 1 02, the secondary storage 1 1 2, or received from the Internet or other network 118. The input 

20 device 1 1 6 may include any device for entering data into the computer 1 00, such as a keyboard, 

2 1 key pad, cursor-control device, touch-screen (possibly with a stylus), microphone, or video camera 

22 (notshown). The display device 110 may include any type of device forpresenting visual image, 

23 such as, for example, a computer monitor, flat-screen display, or display panel. The output device 

24 108 may include any type of device for presenting data in hard copy format, such as a printer (not 

25 shown), and other types of output devices include speakers or any device for providing data in 

26 audio form. The computer 1 00 can possibly include multiple input devices, output devices, and 

27 display devices. 

2 8 Although the computer 1 00 is depicted with various components, one skilled in the art will 
29 appreciate that the computer can contain additional or different components. In addition, although 

3 0 aspects of an implementation are described as being stored in memory, one skilled in the art will 



3 



1 appreciate that these aspects can also be stored on or read from other types of computer program 

2 products or computer-readable media, such as secondary storage devices, including hard disks, 

3 floppy disks, or CD-ROM; a carrier wave from the Internet or other network; or other forms of 

4 RAM or ROM. The computer-readable media may include instructions for controlling the 

5 computer 1 00 to perform a particular method. 

6 Any signal can be represented with scaling functions and wavelet functions. The scaling 

7 functions, wavelet functions, and other image encoding related mathematical formulas and 

8 algorithms are described, for example, in Chuang, et. al. , "Wavelet Descriptor of Planar Curves: 

9 Theory and Applications," IEEE Transactions on Image Processing, Vol. 5,No. 1, January 1996, 

1 0 which is incorporated herein by reference. Chuang, et. al. describe ahierarchical planar curve 

1 1 descriptor that, by using a wavelet transform, decomposes a curve into components of different 

1 2 scales so that the coarsest scale components carry the global approximation information while the 

1 3 finer scale components contain the local detailed information. The wavelet descriptor is shown to 

1 4 have many desirable properties such as multi-resolution representation, invariance, uniqueness, 

15 stability, and spatial localization. 

1 6 Multi-resolution pyramid encoding for image is described, for example, in United Patent 

17 No. 5,477,272, entitled "Variable-Block Size Multi-Resolution Motion Estimation Scheme for 

18 Pyramid Coding," which is incorporated herein by reference. U.S. Patent No. 5,477,272 

1 9 describes a variable-size block multi-resolution motion estimation scheme that can be used to 

20 estimate motion vectors in subband encoding, wavelet encoding and other pyramid encoding 

21 systems for video compression. 

22 In multi-resolution encoding, image information is sent in increments . Every time more 

23 information is transmitted, the image may be better described and rendered. For example, a single 

24 sine wave may be a first approximation of a square wave, which represents an original waveform. 
2 5 Adding more information, for example, a double frequency sine wave with different amplitude, on 

26 top of the original sine wave may generate a second approximation of the square wave. A third 

27 approximation may be generated by adding ahigher frequency sine wave with smaller amplitude, 

28 and so on. Every time a new sine wave is added, a better approximation of the square wave, the 

29 original image, may be generated. 
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1 Multi-resolution encoding techniques may be applied to boundary encoding. Inmulti- 

2 resolution boundary encoding, a periodic wave transfer may be generated with different contents 

3 of frequencies. Figure 2 illustrates an exemplary boundary B-V 0 330 encoded at full resolution. 

4 The boundary is composed of two coordinates, i.e., x(t) and y{f), that evolve in The 

5 combination of the two coordinates generates the whole boundary. 

6 The boundary may be encoded using two one-dimensional periodic wavelet series. 

7 Wavelet series are described, for example, in "Progressive Transmission of Line Drawings Using 

8 the Wavelet Transform" by Muller, et. al., IEEE Transactions on Image Processing, Vol. 5, No. 

9 4, April 1 996, which is incorporated herein by reference. Muller, et. al. present a method to apply 

1 0 progressive transmission to line drawings using wavelet transform. 

1 1 Figures 3(a) and 3(b) illustrate an exemplary method for encoding, i.e., decomposing, two 

1 2 one-dimensional periodical signals using wavelet based encoding at different resolution levels . 

1 3 Examples of one-dimensional periodical signal encoding are described, for example, in "Wavelets 

14 and Subband Coding" by Vetterli and Kovacevic, ISBN 0- 1 3-097080-8, 1 995, 22 1 -223, which 

1 5 is incorporated herein by reference. 

1 6 Referring to Figure 3(a), a one-dimensional curve X(w) is decomposed by subdividing the 

1 7 spectrum represented by frequency "w" and generating frequency coefficients for x(f). For 
" 18 example, waveletcoefficientsinB-V 0 330expandallfrequencybandsfrom0tO7u. Subdividing 

1 9 the spectrum generates coefficients in B-V! 43 0, which contains lower frequencies from 0-nJ2, and 

20 B-W t 440, which contains higher frequencies from n/2 to %. Further dividing the spectrum 

2 1 produces coefficients in B-V 2 530, which carries lower frequency contents from O-ti/4, and B- W 2 

22 540, which carries higher frequency contents from tt/4 to n/2. Yet further dividing the spectrum 

23 produces coefficients in B-V 3 63 0, which contains lower frequency contents from 0-tc/ 8 , and B- 

24 W 3 640, which carries higher frequency contents from n/8 to tc/4. 

25 Figures 4(a)-(c) illustrates how the exemplary boundary shown in Figure 2 is represented 

26 in multi-resolution encoding. First, a few data bits with lowest frequency coefficients, which 

27 represent the most basic boundary information, are sent to a receiver during transmission. Then, 

28 more data bits with higher frequency coefficients may be sent to render a better approximation of 

29 the boundary. The more data bits with higher frequency coefficients are transmitted, the closer 

30 representation the boundary is to the original image. 
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1 As shown in Figure 4(a), X(w) and Y(w), which form the transformed boundary, may be 

2 reconstructed by first receiving B-V 2 530, which contains the lowest frequency contents. Then, 

3 B-W 2 540, which carries mid-range frequency contents, may be received, thereby creating a better 

4 boundary. B-V! 430, shown in Figure 4(b), maybe generated by combining B-V 2 530 and B-W 2 

5 540. Lastly, B- W x 440, which contains the highest frequency contents, may be received, and B-V 0 

6 330, the original boundary shown in Figure 4(c), may be generated by combining B-Vx 430 and 

7 B-Wj 440. As a result, B-V 0 330 is the combination of B-V 2 530, B-W 2 540 and B-W x 440. 

8 Figure 5(a) illustrates an exemplary multi-resolution representation for boundaries. An 

9 image, such as a snowflake, may be transmitted by sending frequency coefficients in increments. 

1 0 The original image with the highest frequency coefficients is shown in (0) . The image with the 

1 1 lowest frequency coefficients, i.e., the basic shape, is shown in (8). If a receiver has higher 

1 2 transmission capability, higher frequency coefficients may be added to generate the image shown 

1 3 in (7), and so on. As illustrated in multi-resolution wavelet based boundary encoding, each time 

1 4 more information is received, the image boundary may be enhanced slightly with higher resolution, 

1 5 i.e., more detail. As for the final layers of transmission shown, for example, in (3), (2), (1), the 

1 6 enhancements generated may not be perceivable by human visual system, and the coefficients that 

17 generate (3), (2), (1) do not need to be protected against channel errors. Accordingly, high 

1 8 frequency bands may be discarded, leaving only lower frequency representation. Multi-resolution 

1 9 boundary encoding enables the basic shape of boundaries to be preserved by transmitting only a 

20 few coefficients. 

2 1 Multi-resolution wavelet based boundary encoding offers a better approach than chain 

22 codes or Fourier series encoding, where if one data bit in the chain code is missing, the whole 

23 boundary is misplaced. Figure 5(b) illustrates an exemplary comparison of Fourier series encoding 

24 and wavelet based encoding. Fourier series based encoding uses sine and cosine infinite 

25 waveforms, thus there is no spatial representation. If the frequency of the infinite waveform is 

26 changed slightly, the overall appearance of the image and boundary may be changed. The wavelet 

27 transform, however, has good localization both in space and in frequency. 

28 The original waveform is shown in (a). Changing one coefficient slightly in the Fourier 

29 series encoding generates (b), while changing the similar coefficients slightly in wavelet based 

30 encoding generates (c) and (d). As illustrated, in Fourier series encoding, an error in transmission, 
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1 represented by a slight change in one coefficient, disturbs the entire boundary. On the other hand, 

2 in wavelet based encoding, a similar error results in localized movement of the boundary. 

3 Therefore, if errors exist in the transmission, a receiver is still able to recover the basic coefficients 

4 and render a close approximation of the boundary. 

5 The advantage of localization of modification may be shown best in wireless image 

6 transmission, where noisy channels are used and errors frequently occur. An error in transmission 

7 may affect one or more of the coefficients, typically the high frequency coefficients because the high 

8 frequency coefficients are not as protected as the low frequency coefficients. In Fourier series 

9 encoding, such errors may cause the entire image boundary to be misplaced. However, wavelet 

1 0 based encoding enables the boundary to remain the same, except for the isolated region subj ect 

11 to the error, as illustrated in Figure 2(b). Accordingly, wavelet based encoding, more localized and 

1 2 more resilient to errors in transmission, is a preferred encoding method for describing boundaries. 

1 3 Figures 6(a)-(c) illustrate an exemplary image encoding using a subband coding (SBC) 

1 4 technique. Region based subband coding (RBSBC) is described, for example, in "A Region-Based 

15 Subband Coding Scheme" by Casas, et. al, Signal Processing: Image Communication 10 (1997) 

16 1 73-200, which is incorporated herein by reference. Casas, et. al. disclose a region-based 

1 7 subband encoding scheme intended for efficient representation of the visual information contained 

18 in image regions of arbitrary shape. QMF filters are separately applied inside each region for the 

1 9 analysis and synthesis stages, using a signal-adaptive symmetric extension technique at region 

20 borders . The frequency coefficients corresponding to each region are identified over the various 

2 1 subbands of the decomposition, so that the encoding steps, namely, bit-allocation, quantization and 

22 entropy encoding, can be performed independently for each region. 

23 An original image I-V 0 3 1 0 is shown in Figure 6(a). I-V 0 3 1 0 may be filtered and 

24 downsampled to generate subbands I-V 1LL 410, 1-W 1HL 421, 1-W 1LH 423, and I-Wjhh 425, as 
2 5 i llustrated in Figure 6(b) . The frequency representations are illustrated in Table 1 . The subbands 

26 I-V 1LL 410, 1-W 1HL 421, 1-W 1LH 423, and I-W 1HH 425, drawn on a smaller (1/4 size) grid, may 

27 be combined to reconstruct I-V 0 3 1 0, the original image. 
28 

29 
30 
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1 Table 1 



2 




Horizontal Frequencies 


Vertical Frequencies 


3 


LL 


Low Pass 


Low Pass 


4 


LH 


Low Pass 


High Pass 


5 


HL 


High Pass 


Low Pass 


6 


HH 


High Pass 


High Pass 
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8 Referring to Figure 6(c), the subband I-V 1LL 4 1 0 may be further filtered and downsampled 

9 to generate subbands I-V 2LL 5 1 0, 1-W 2HL 521 , 1-W 2LH 523, and I-W 2HH 525 . The subbands I- 

1 0 V 2LL 5 1 0, 1-W 2HL 52 1 , 1-W 2LH 523, and I-W 2HH 525, drawn on a yet smaller (1/1 6 size) grid, may 

1 1 be combined to reconstruct I- Vj LL 4 1 0 . 

1 2 Figures 7(a)-(d) illustrate an exemplary multi-resolution decomposition of an image and an 

1 3 associated boundary. Figure 7(a) illustrates an original image I-V 0 3 1 0 composed of a set of 

1 4 regions, i.e., R x 71 0, R 2 720, R 3 730, and R4 740. The Regions are defined by a set of boundaries 

15 inB-V 0 330,i.e.,Bi 810,B 2 820,B 3 830,andB 4 840. Referringto Figure 7(b), the original image 

1 6 I-V 0 3 1 0 may be filtered and downsampled to generate subbands I-V 1LL 410, 1-W 1HL 42 1 , 1- W 1LH 

17 423, 1- W 1HH 425 for each of the regions within the image. I- V 1LL 4 1 0 may be generated using low 

1 8 pass horizontal and low pass vertical (LL) frequency filters, I- W 1HL 42 1 may be generated using 

1 9 high pass horizontal and low pass vertical (HL) frequency filters, I-W 1LH 423 maybe generated 

20 using low pass horizontal and low pass vertical (LH) frequency filters, and I-W 1HH 425 may be 

21 generated using high pass horizontal and high pass vertical (HH) frequency filters. All four 

22 subbands have the same boundary resolution, i.e., B-Vj 430. 

23 Figure 7(c) illustrates a further decomposition, where the LL frequency subband I-V 1LL 4 1 0 

24 is further filtered and downsampled for each of the regions, generating smaller subbands I- V 2LL 

25 510, 1- W 2HL 52 1 , 1- W 2LH 523 , 1- W 2HH 525 . The subbands I- W 1HL 42 1 , 1-W 1LH 423 , 1- W 1HH 425 

26 remain the same. The subbands I-V 2LL 510, 1- W 2HL 52 1 , 1- W 2LH 523 , 1-W 2HH 525 have the same 

27 boundary resolution, i.e., B-V 2 530, which has a lower resolution than B-V! 430. 

28 Figure 7(d) illustrates another level of decomposition, where the LL frequency subband I- 

29 V 2LL 5 1 0 is further filtered and downsampled for each of the regions, generating yet smaller 



1 subbands I-V 3LL 610, 1-W 3HL 62 1 , 1- W 3LH 623 , 1-W 3HH 625 . The subbands I- W 2HL 52 1 , 1- W 2LH 

2 523, 1-W 2HH 525 remain the same as before. The subbands I- V 3LL 6 1 0, 1- W 3HL 62 1 , 1-W 3LH 623 , 

3 I-W 3HH 625 have the same boundary resolution, i.e., B-V 3 630, which has ayet lower resolution 

4 than B-V 2 530. 

5 Decomposition may be performed as many times as necessary to encode the image and 

6 the corresponding boundary. Because downsampling is typically performed in both directions, one- 

7 fourth of the original data remains after each filtering. After filtering, a pyramid is generated with 

8 different frequency contents, i.e., resolutions. However, only four or five decompositions are 

9 typically performed. As a result of the multiple levels of decomposition, a complete image 

1 0 compression may be generated based on wavelet coefficients for the boundary and subband 

1 1 coefficients for the image. 

1 2 In transmission, image and boundary information may be sent using j oint source channel 

1 3 coding (JSCC) to protect the information against channel errors. JSCC describes techniques in 

1 4 which the compression function and the error control function in a communication system are 

1 5 combined in some way. For example, encoding of the boundary and image may be modified so 

1 6 that different resolutions may be protected unequally against errors in transmission channels, i.e., 

1 7 the most important coefficients with respect to the human visual system (HVS) may be well 

1 8 protected, where the least important coefficients are less protected. 

19 For example, when video signals are transmitted, image and corresponding boundary 
2 0 coefficients with the lowest resolution may be sent first. Next, image and boundary coefficients with 

21 a higher resolution may be transmitted, and so on. There are more data bits, i.e., energy, to be sent 

22 to encode a boundary in a subband with higher frequency. Image compression in source encoding 

23 is, in part, obtained by removing or coarsely encoding some of the coefficients in the higher 

24 frequency bands, i.e., quatitization process, as the HVS typically may not notice the difference. 

25 Channel encoding assigns error protection to the image and boundary information, and JSCC 

26 organizes the source coded coefficients in the order of importance with respect to the HVS. JSCC 

27 then applies channel encoding techniques to the source coded coefficients, providing more 

28 protection to the more important, i.e., low frequency, coefficients and less protection to the less 

29 important, i.e., high frequency, coefficients. 
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1 Figures 8(a)-(e) illustrate an exemplary process of progressive reconstruction of a 

2 decomposed image and an associated boundary. First, referring to Figure 8(a), boundary 

3 information with the lowest resolution, i.e., B-V 3 630, may be transmitted. Then, image information 

4 in the lowest subband I- V 3LL may be sent to fill the boundary. The lowest resolution boundary and 

5 image information, which are well protected against noises and transmission errors, are good 

6 representations of the original image at lower frequency. A receiver with low bandwidth may still 

7 recover this basic approximation. 

8 Referring to Figure 8(b), image information in the other three subbands I- W 3HL 621, 1- 

9 W 3LH 623 , and I- W 3HH 625 may be sent. The four subbands I-V 3LL 6 1 0, 1- W 3HL 62 1 , 1- W 3LH 

1 0 623, and I-W 3HH 625 share the same boundary resolution, i.e., B-V 3 630. This level of image 

1 1 information is less protected against errors. A handheld wireless device, which operates in noisy 

1 2 channels and has smaller displays, typically only receives this level of approximation. However, the 

13 handheld wireless device may still render a video on the small display, which is a close 

14 representation of the original boundary and image. 

1 5 InFigure 8(c), the four subbands I-V 3LL 610, 1-W 3HL 621 , 1-W 3LH 623, and I-W 3HH 625 

1 6 may be combined to reconstruct the image information in I- V 2LL 510. Next, higher resolution 

1 7 boundary information in B-W 3 640 (not shown in Figure 8) may be sent. B-V 3 630 and B-W 3 640 

1 8 maybe combined to reconstruct B-V 2 530, which has a higher resolution. Then, image information 

1 9 in the other three subbands I-W 2HL 521 , 1-W 2LH 523, andI-W 2HH 525 maybe transmitted. Again, 

20 the subbands I- V 2LL 5 1 0, 1- W 2HL 52 1 , 1- W 2LH 523 , and I-W 2HH 525 share the same boundary 

2 1 resolution, i.e. , B- V 2 5 3 0. The higher resolution boundary and image information are even less 

22 protected against transmission errors. 

23 Similarly, in Figure 8(d), the subbands I-V 2LL 5 1 0, 1- W 2HL 52 1 , 1- W 2LH 523 , and I-W 2HH 

24 525 may be combined to reconstruct the image information in I-V 1LL 4 1 0. Next, higher resolution 

25 boundary information in B-W 2 540 (not shown in Figure 8) may be sent. B- V 2 530 and B-W 2 540 

26 may be combined to reconstruct B-Vj 43 0, which has yet a higher resolution. Then, image 

27 information in the other three subbands I-W 1HL 421, 1-W ILH 423, and I-W 1HH 425 may be 

28 transmitted. Once again, the subbands I-V 1LL 410, 1-W 1HL 421, 1-W 1LH 423, and I-W 1HH 425 

29 share the same boundary resolution, i.e., B-Vj 430. The boundary and image at this level of 
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1 resolution are more vulnerable to errors in transmission, because they are not well protected in the 

2 channel coding steps. 

3 Lastly, referring to Figure 8(e), the subbands I-V 1LL 410, 1-W 1HL 42 1 , 1-W 1LH 423, and 

4 I- W 1HH 425 may be combined to reconstruct the original image I-V 0LL 310. The original image I- 

5 V 0LL 3 1 0 may be reproduced at a receiver. In this embodiment, the highest frequency coefficients 

6 in B- W[ 440 do not need to be transmitted. If a receiver, for example, a high definition television 

7 or a desktop computer, is able to receive the levels of coefficients described above without error, 

8 the receiver may receive a high resolution high quality video scene, or even recover the original 

9 image, as shown in Figure 8(e). 

1 0 Accordingly, multi-resolution encoding both in boundary and in image allows a system 

1 1 designer to protect different sets of coefficients according to transmission channel ' s condition. 

1 2 Different receivers, using different channels, may receive different amount of bits per second, i.e., 

1 3 bandwidth. Hand held low resolution devices may utilize only lower frequency resolution, which 

1 4 is well protected. Other receivers, such as high definition televisions, use better channels with 

1 5 higher frequency band and can receive better image quality. 

1 6 The image encoding and the boundary encoding use the same subbands for convenience 

1 7 purposes only. The two types of encoding may be performed separately and do not need to use 

1 8 the same subbands. In addition, instead of using RBSBC for the image encoding, other encoding 

19 methods may be used. 

20 Figure 9 is a flow chart of the exemplary decomposition and reconstruction process 

2 1 illustrated in Figures 7 and 8 using multi-resolution boundary encoding. An original image I-V 0 3 1 0 

22 may be divided into aplurality of regions, such as Rj 7 1 0, R 2 720, R 3 73 0, and R4 740, step 910. 

23 A plurality of boundaries, such as Bj 8 1 0, B 2 820, B 3 830, and B 4 840, may be detected, step 

24 910. Next, each of the boundaries may be encoded by two periodic wavelet series, one for x(t) 

25 and one forX0> so mat eacn boundary may contain different sets of wavelet coefficients, step 912. 

26 For example, for a three level decomposition, B-V 0 330 may be composed of 2N wavelet 

27 coefficients, N forx(0 andN fory(0> B-V"! 430 maybe composed of N wavelet coefficients, N/2 

28 for x(t) and N/2 for y(t), B-V 2 530 may be composed of N/2 wavelet coefficients, N/4 for x(f) 

29 and N/4 for.y(0> and B-V 3 630 may be composed of N/4 wavelet coefficients, N/8 for x(t) and 

30 N/8 for X0- 



1 Next, using the boundaries with the highest resolution, i.e. , B- V 0 330, each of the regions 

2 in the original image I-V 0 3 1 0 may be decomposed into, for example, four subbands, using a 

3 RBSBC scheme, step 9 1 4 . The four subbands may be LL subband I-V 1LL 4 1 0, HL subband I- 

4 W 2HL 521, LH subband I-W 2LH , and HH subband I-W 2HH , steps 916, 918, 920, and 922, 

5 respectfully . In the next step, using lower resolution boundaries, each of the regions in the LL 

6 subband may be successively decomposed into further four LL, LH, HL, and HH subbands, step 

7 924. For example, using the boundary B-Vj 430, each of the regions in the LL subband, i.e., I- 

8 V 1LL 410, maybe further decomposed into I-V 2LL 510, 1-W 2HL 521, 1-W 2LH 523, 1-W 2HH 525. 

9 In addition, using the boundary B-V 2 530, each of the regions in the lower resolution LL subband, 

1 0 i.e., I-V 2LL 5 1 0, may be further decomposed into I-V 3LL 610, 1-W 3HL 621 , 1-W 3LH 623 , 1-W 3HH 

1 1 625. Accordingly, after the successive decomposition, the following subbands are generated: one 

1 2 subbands with the lowest image resolution I-V 3LL 610, three subbands I- W 3HL 62 1 , 1- W 3LH 623 , 

1 3 I-W 3HH 625 , three subbands with higher image resolution I- W 2HL 521, 1-W 2LH 523, 1-W 2HH 525 , 

14 and three subbands with even higher image resolution. 

1 5 During transmission, these boundary and image information may be sent using JSCC to 

16 protect me information against channel errors. First, the lowest resolution boundary B-V 3 630may 

1 7 be sent, step 926. This boundary information has the highest error protection. Next, the image 

1 8 information in the lowest resolution subband I-V 3LL 610 may be sent, step 928. This image 

1 9 information, again, has the highest error protection. In step 93 0, the image information in the lowest 

20 resolution subbands I-W 3HL 621 , 1-W 3LH 623, 1-W 3HH 625 may be transmitted. The subbands I- 

2 1 V 3LL 610, 1- W 3HL 621 , 1-W 3LH 623, and I-W 3HH 625 may be combined to reconstruct I-V 2LL 510 

22 in a receiver, step 932. 

23 In the next step, boundary information in a higher resolution may be successively 

24 transmitted, step 934, together with the image information in a higher resolution HL, LH, and HH 

25 subbands, step 936. Similarly, the subbands LL, HL, LH, and HH may be combined to 

26 reconstruct image information in a higher resolution, until the original image I-V 0 310 is 

27 reconstructed, step 93 8 . For example, boundary information in B-W 3 640 may be sent, which, 

28 by combining B-V 3 630, may generate the boundary at resolution B-V 2 530, which has high 

29 protection. Then, the image information in I- W 2HL 52 1 , 1- W 2LH 523 , 1- W 2HH 525 may be sent, 
3 0 which may be combined with I-V 2LL 5 1 0 to reconstruct I-V 1LL 4 1 0 . Next, boundary information 



1 in B-W 2 540 may be sent, which may combine with B-V 2 530, to generate the boundary at 

2 resolution B-V\ 430, which has medium protection. Finally, the image information in I- W iHL 421, 

3 I- W 1LH 423 , 1- W 1HH 425 may be sent, which may be combined with I-V t LL 4 1 0 to reconstruct the 

4 original image I-V 0 3 1 0 in the receiver. 

5 While the method for multi-resolution boundary encoding has been described in connection 

6 with an exemplary embodiment, it will be understood that many modifications in light of these 

7 teachings will be readily apparent to those skilled in the art, and this application is intended to cover 

8 any variations thereof. 
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